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(54) BmpSfe?! Interleaving, a family oS systematic intesleavers and delrtterteavers 

(57) Apparatus shai realizes a substantial advan- 
tage by errpioysng jnngjItecJ interleaving to create a sys- g, *f j ^ 
lemalic inierSeaver, that car? result in a superior block 
error rate compared to the current data interfeavirig 
techniques in which uncorrected error bursts are distrib- 
uted by the desnterieaver. The disclosed principles lead 
to a embodiments ?ha! essentially eliminate transmitter 
memory regardless of the intedeaving approach 
employee. Sy way cJ sxampie : block interleaving (regu- 
lar or random), corwolutiona> interleaving (regular and 
random) and product interleaving approaches are 
described, in implied interleaving, all incoming dsla is 
treated as if tt is pre-irrferleaved anci transmitted directly 
to 'to destination without atteration to its sequence, and 
essentia!!)-' without delay. Concurrently with the trans- 
mission of the data, the data is applied to apparatus that 
treats the data as if it had been interleaved in accord- 
ance with a selected interleaving approach and. in 
accordance with such treatment, redundant symbois 
are generated and inserted into the transmitted data 
stream. Ai the receiver, the incoming data is delayed, 
corrected, and the information symbols in the incoming 
data are delivered to the user, corrected as necessary, 
in the same oroar as the information symbols arrived at 
the receiver. 
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5 This invention relates to systematic interleavers and deirrierfeavers that are used >rt conjunction with error correct- 

ing coders, 

Cammursication 0* signals invariably must deal with transmission of signals through noisy channels where errors 
are introduced. FIG. 1 presents the block diagram of a fairsy sophis Heated prior art arrangement for such an environ- 
ment, where data is first applied to encoder i go, the encoded data is passed on to irtferleaver 200. the interleaved date 
m is modulated in block 300 and the modulated data is appiied to the channel. The signal provided by the channel is 
demodulated in btock 400. deanterleaved in Week 500 and decoded in block 600. 

Snterleaver 200 is interposed in the system in order to account for burst errors in the channel. Specifically, inter- 
ieaver 200 disperses adjacent signal elements in tame prior to modulation, that burst errors do not affect too many adja- 
cent signal elements ci the original uninterlaaved signal. Conversely, when considering the signal coming from the 
?s channel, errors that srs closely spaced in time are interspersed at the output and are. therefore, far apart from each 
other. The consequence of this dispersing is that decoder 600 is able fo recover the data entered into encoder 100 by 
virtue of the error-correcting redundancy included in the signal which decoder 600 utilizes. 

As is well known, moduiator 300 and demodulator 400 may be subsystems that themselves include robust coding 
and decoding. For example, modulator 300 may include a front end section that is a trellis encoder. Correspondingly. 
s-3 the tail-end of demodulator 400 would include, a Viterbi decoder. 

A substantial advantage is realized irs accordance with the principles disclosed herein by employirtg. implied aiter- 

ss leaving. An implied interiaaver is & systematic mterieaver. which is one that does not alter the incoming data sequence, 
and ss such may resuit in 3 superior block error rate, compared to the current data interleaving techniques in which 
uncorrected enor bursts are distributed by the deinterleaver. 

While in other interleaving and encoding approaches the encoding apparatus requires memory and imposes delay 
upon some of the transmitted signal, impfied interleaving essentially dispenses with ail memory and corresponding 

30 de-ay in the transmitter- encoder By way at example, block interleaving, convolutionat interleaving, random and product 
tnterSeaving approaches are described. The only memory that is needed is the one which is normally provided tor the 
speed-up in the data rate to create room for the insertion of redundant symbols in the transmitted data stream. Concur- 
rently with its transmission, the data is applied to apparatus that tr eats the data as if it had been interleaved in accord- 
ance with a selected interleaving approach. in accordance with such treatment, redundant symbols are generated and 

35 inserted into the transmitted data stream. 

At the receiver, the incoming data is delayed, corrected, and the infer masion symbols in the incoming data are deliv- 
ered to the user, corrected as necessary, in the same order as the information symbols arrived a! the receiver. Since 
the data sequence is r>ct chana.ee at the receiver, the decoder can operate on the data directly inside the deinter leaving 
memory The errors are therefore corrected in-place, without the need for muflipie data storage at the decoder input and 

40 ouiput stages. 

Brief Description g l ares Drawing 

FIG. 1 shows a pner art coder/decoder arrangement with an interleaver and a deinEerleaver-in!erfeaver interposed 
as therebetween; 

FIG, 2 illustrates block interleaving: 

FIG. 3 presents a memory map arranged for bfock interleaving; 
FIG. 4 illustrates convolutions! interleaving; 

FIG. S presents a memory map tor a conwlutional code where codewords are of length 1 1 and the interleaving 
ss depth is 5; 

FIG. 6 presents & memory map for a convolutionai code where codewords are of length 1 1 and the interleaving 
depth is 7; 

FIGS. 7-9 correspond to FIGS. 3. 5. and 6, with the redundant symbols shown: 
FIG. 10 is a olock Siagrarrs of one realization of an encoder following the principles disclosed herein: 
ss FIGS. 1 1 -12 are other embodiments of the principles disclosed herein; 

FIG. 13 is a block diagram of a receiver suitable for encoder arrangement of FiG. 10, and it is a<so a depiction of 

the most compact transmitter ; 

FiG. 14 presents & memory map for product encoding; 

FiG. 1 S is an encoder arrangement for the FIG. 14 product code: and 
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FIG. 16 illustrates random corwotutionaS interleaving. 



Interleaving algorithms and techniques were introduced io ihe art of communication in order to increase the noise 
; mmuniEy of systems mat are siibjecl to burse errors. Inierleaving algorithms define the relations among data sequences 
of different codeword blocks on the transmission channel, and interleaving techniques define the implementation meth- 
ods to achieve these relations. Examples oJ interleaving algorithms are biock interleaving, and convolutiorsas interleav- 
ing. Examples of interleaving techniques, are data interleaving and code interleaving. 

In data interleaving, information is first applied to an encoder, and the encoder's output is interleaved In coo"' 
interleaving (a rarely used technique), the information is interleaved first aixf then applied to the encoding process This 
technique is described by R. G. Ga! lager in "information Theory and Reliable Communication John 'Wiley & Sons 
^968. pp. 286 et seq (FiG. 2) Gallager presents an Interlaced interleaving in a block interleaved arrangement where 
the incoming (reformation are gated to multiple encoders. The Interlaced Interseaving approach is an example of code 
interleaving wher B the information is interleaved first and then encoded. Gallager employ a plurality of encoders tn 
effect, he deintarleaves the information, routes the deitHer leaved information to the encoders, and then re-interi eaves 
the informal and the redundant symbols. He has apparently not reaped that data can be viewed a being pre-inter- 



An understanding of interleaving algorithms can be gained by looking a! the movement of data symbols in the time 
m domain, as shown tor example in FIG. 2, or by viewing the process of storing data in a matrix in accordance with one 
procedure end .-strieving tt irs accordance with another procedure, as shown for example in FIG. 3. Both FIGS 2 and 3 
illustrate block interleaving; 

In block interleaving, a block of data is rearranged to insure that consecutive symbols in the block prior to interleav- 
ing are not adjacent in the block after the interleaving A clear characteristic of block interleaving is that tne interleaved 
-m data can be separated inrto blocks of consecutive symbols which correspond to blocks of consecutive symtoois in the 
uninterleavad data. The orrfy difference between the two corresponding blocks is in the sequence of symbols in the 
blocks. 

For illustrative purposes. FIG. 2 depicts two blocks of data, 1 0 1 and 1 02, each having N*D symbols More particu- 
larly, each block includes D groups (codewords) of N symbols each. Since block interleaving rearranges the sequence 

w of symbols, ft >s clear that a defay must be introduced in order to allow later arriving symbols to appear earlier in the 
interleaved output To & first degree of approximation, in block encoding, the interleaved date of each block can be 
obtained only after the entire block of data has arrived. This is depicted by blocks 103 and 104 in FIG. £ which corre- 
spond to the interleaved data of blocks 101 and 102. respectively. The interleaving of data is accomplished by taking 
consecutive symbois of each codeword, artd dispersing them at intervals of 0 symbols in blocks 1 03 and 1 04 (the value 

as of D being the interleaving depth). Thus, the i st symbol of the first codeword in block 101 (line 1 11 ) becomes the 1 s! 
symbol of codeword 103, the 3nd symbol Of the first codeword of block 101 {line 1 12) is moved to be the <D*-l) m symbol 
cl codeword 103. tne third symbol of the first codeword of block 101 (line 113? is moved to be the (20+1)* symbol of 
codeword 103. etc. 

In the same interleaving procedure, but viewed another way, the first symbol of the 1st codeword in block 102 (line 
« 114) becomes the mi symbol of codeword 1 04. tie first symbol oi the 2nd codeword in block 1 02 (line n 5) is moved 
to be the 2nd symbol of codeword 1 04, ete; 

if the data of block 1 01 Is written into successive cetis of a storage element, then the above described interleaving 
can be realised by simply reading data out in jumps of D cells. If the storage element is viewed as a mat™ as depicted 
;n FIG, 3. and data is written into the matrix a column at a time, where each column contains a number of celts equal to 
is the number of symbols tn a codeword, then each codeword occupies a column (see shaded area in the first column? 
and the above-described interleaving is realized by reading data out of the matrix, a row at a time. 

As indicated above, the interleaving described in connection with FIGS. 2 and 3 is block interleaving where one 
cars identify a block o! Input data and a corresponding biock of output data. The output Week contains only tne data of 
Jhe input biock. 

so In conTOlutsorsai interleaving, no output block of contiguous data signals can be found that corresponds to an input 

biock ot data, in the sense of containing only the data of the input block. 

A convolution^ interleaving arrangement is depicted in FIG. 4. where the codeword length. N. is 1 1 symbols and 

the interleaving depth. D, is 5. It may be said thai input block 105 supplies data to an interleaved output symbol 

sequence 1 05 of length n*d. but it supplies only some of the symbols for sequence 1 0S. and it also supplies data to a 
ss foilawrtg symbol sequence The latter data is illustrated by the 20 (short) up-arrows in block 105. Correspondingly 

sequence 106 recedes symbols from the block that is previous to biock 105. and thai data is illustrated by the 20 (short) 

down-atrews in sequence 1 06. 

FIG. 5 is a nratrix representation of the FIG. 4 interleaving, and it contains 11 rows and 5 columns. Flowing the 

teachings of Asfams et at in "A Selective Error Correction Proposal for ADSL", ANSI Contribution TlEl .4/03-023. March 
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8, 1 993. if the codewords A through £ of FIG. 4 are written in columns as depicted in FIG. S, then data that is read out 
from the matrix a row at a time yields the convolutions! interleaving of FIG. 4. More specifically, for an arrangement 
where N=1 1 and D=5, if data ss written a column at a time, with each successive codeword being generally staggered 
by 2 rows (codewc-fd 0 starting at row 0, arid each codeword i starting at row 2i), then s straight reading-out by rows 
5 results in an interleaved output. 

A number of attributes should be noted m connection with the storage of data in a matrix, and the teaching of 
Asianis etal. 

i ) Asianis et ai stats that N and D must be co-prime in aider for this arrangement to work; although they recognize 
to teas when N and O are not co-prime dummy symoote can create a co-prims relationship. However, the data a! the 
tnterieaver output is NOT uniformly distributed. One gets K*(N/D) of symbols with a spacing of D and then one gets 
a symbol with a spacing of D+1 (K is the largest common divisor). The total system delay is increased by D/K sym- 
bols 

2} Different sets cf N and D values will result in different staggering in rows and columns. Thus, for example, code- 
's woias that are adjacent in tf.e ivtmi w-s&s &tf earr; may not be ■« adiasjent fsjiiifw-s «f the matrix . Tras is illustrated in 
FIG.. 6. where N*1:1 and D=7 

3) Asianis et ai boiieved that both block interleaving and convoSutional interleaving require an interleaving memory 
0) N^DsymboSs- 

4; !n tbe convoiutional interleaving described by Asianis et al and the associates! storing of data in the matrix, the 
so first symbol in easb codeword experiences no delay. The data is written and then read-out immediately thereafter. 
Other symbols, however, incur a delay that varies with the symbol position in the codeword. On the receiver side 
the demtorlasved data is again delayed by different amounts with the total dsiay being ©qua' across all data sym- 
bols. 

zs Etf-jctiveiy £grg ^niJarm delay can be achieved by assuming that the data to be transmitted is actually the inter- 
leaved resuii al some other imagined data to which an interleaving algorithm had been applied. With such an assump- 
tion, any interleaving algorithm can be assumed to have been applied to this imagined data, with essentially no 
associated increase in the complexity of the encoder or decoder. Staled in other words, if the data comes already inter- 
leavee', :he memories into which the data is inserted in accordance with the depictions ot FIGS. 5 and 6 are not needed. 

;» With the available data already "interleaved", all that remains to be dene ss to encode the data and transmit it. Th's 
leads to the implied interleaving concept, with its systematic characteristic, lor all types of interleaving algorithms not 
just block interleaving. 

In applications where the encoding comprises merely the addition of a number of redundant, error correcting sym- 
bols/syrr-bols, a rate conversion must be executed to provide the time siots in which the redundant symbols are kept. 

as and that requires some minimal amount of memory. The redundant error correcting symbols are symbols that are asso- 
ciated with a group o* consecutiy;; senate in She unirAsrts&vsd dais. This memof y is siorrrsaiiy f-et^St?:; at each er>e<xier 
and distributed over the multiple encoders. By combining atl distributed smali buffers into a single one at the data input, 
additional reduction isi total rate conversion memory is achieved where the combined memory can be as smalt as one 
of the small buffers al one of the encoder inputs. Effectively reducing the memory by another factor 0. 

« It the matrix arrangements of FIGS. 3, 5 and 6 were viewed the with 2 error correcting symbols added to each code- 
word, the result woulci be as presented in FIGS. 7, 8 and 3. respectively, tt may be noted that with the particular inter- 
leaving that was implied, ths positions of the codewords in columns of the matrices are different from those in FIGS. 3, 
5 and 6. The cells containing numbers {1,2,3,4 and 5) designate the ceils where the codewords start, and the cioss- 
hatcbed cells are the cells that contain the error correcting symbois. To reiterate, however, when the data comes in 

45 already interleaved, the ssuarf^ernerns of FIGS. 7-9 as well as FIGS. 5-& do not represent needed memory, bul are 
shown merely to assist in understanding trie invention. 
Compared with Asianis et al: 

) H and D can be of a^y ratio and the data can be uniformly distributed, based only an designers choice; 
so 2) The staggering in rows and columns lo different sets of N and D values and are the sole choice of the designer; 

3.; Both block interleaving and convoiutional interleaving require no transmit deiay; 
4- Ai! symbols mast a zero delay, regardless of their position in the codeword; and 
5) Multiple channels with different encoders and interleaving depth can be interleaved in the same circuit. 

ss Moreover, there are muitiple encoder architectures that can be employed within the scope of the principles disclosed 
herein. One can have an architecture that is similar to that of Gaiiager {with appropriate added controllers), one can 
have an architecture that includes a buffer at the common input, buffer in the data path and in the encoders, multiple 
buffers at the input to allow multiple channels, buffer at the output instead of at the input or an architecture where al! 
memory needs are met with a single RAW and an ALU with an associated controller. 



4 



A dsta transmi^g module in accordance with the principles disclosed herein is depicted in RG. 10 with Reed 
So'omors encoding. Specifically. FIG. 10 includes a small FIFO buffer 220 whose output is transmitted to channel 10 via 
multiplexer 221. The output of buffer 220 is also applied to a router 222 which feeds a number of RS (Reed Solomon) 
encoders equal to trie interleaving depth, 0. of which encoders 223, 224, 225 are shown. The encoders develop error 

s correction symbols and, at the appropriate times* those symbols are transmitted to channel 10 via router 226 and mul- 
tiplexer 221 . Buffer 220 provides the buffer necessary for rate conversion. The amount o! memory is dependent on the 
specifics of N and D. as well as on the nature of the assumed interleaving algorithm. Thus, for the Week interleaving of 
FIG. 7. tor example, while the last two tows of the matrix (the error correcting symbols) are applied to the communica- 
tion channel, aii incoming data symbols must be buffered. While the 10 error correcting symbols of she FIG. 7 arrange- 

,o ment are applied to channel 1 0 (and all form a singJe uninterrupted sequence when read cut from the matrix), there are 
(I0>i55>/S5 symbols thai arrive which must be buffered. Hence buffer 220 requires ten symbols of storage, in the con- 
volutions! interleaving of FiGS. 8 and 9, on the other hand, the longest sequence of error correcting symbols applied to 
crsame! 10 is t in FIG. 8 and 2 in FIG. 9. Hence, buffer 220 requires only a minimal number of storage symbols, a single 
symbol of storage or two, respectively. Viewed another way, the buffer needs to contain enough information so. that 

,$ white symbols are inserted at one rate and extracted at a higher rate, the buffer wilt not fail to contain symbols when 
symbols needs to be extracted- This leads to the relationship that the buffer needs to b© as large as N{(T(/f>i] raised 
to the next integer, where M is the largest block of extracted symbols between redundant symbols, and T 0 and Ti are 
the output and input rates, respectively. 

Elements 222 and 226 are obviously affected by the interleaving algorithm that is assumed to have been applied 

so to the "interleaved" mi&. Multiplexer 221 needs to know when the data symbols are communicated from buffer 220 and 
when the error correcting symbols are communicated from combiner 226. and router 222 needs to know where to route 
the data symbols, in accordance with the assumed, or implied, interleaving. 

For essample. if it is assumed that the incoming data has been block interleaved in accordance with FIG. 7. the sym- 
bol corresponding to the cei; in the first row and the first column is designated to be the first symbol of the first codeword, 
■as and accordingly, it is routed by element 222 to an RS encoder (e.g. , encoder 223) that had been reset immediately prior 
to the arrival of that symbol: The next symbol, designated to be the first symbol of the second codeword, is routed by 
element 222 to a second PS encoder (e.g., encoder 224) that had been reset immediately prior to the arrival of that 
symbol: and the same treatment is applied to the remaining three symboJs. According to FIG. 7. after channel 10 
receives 55 symbofs from buffer 220 via multiplexer 221 (and at thai time the same 55 symbols sre applied to RS 

so encoders 223-225 via router 222, the channel receives the nest 10 symbols from the RS encoders via combiner 226 
and multiplexer 221 . » may be noted in passing that combiner 226 and multiplexer 22 1 can be impiernented in a single 
combiner, but it is shown here as two elements to mate the description dearer. 

in light of the above example, one can view the sequencing as being divided into two segments: a 55 symbol "data 
symbols" segment arid a 10 symbol "error correcting symbols" segment. During the data symbols segmer?t router 222 

as sequentially cycles through 5 encoders, and during the first 5 symbols of the data segment each RS encoder to 
which data is routed is reset prior to the application of the data symbol. During the data symbols segment, multiplexer 
221 is set to pass the data out of buffer 220 to channel 10, and the actions of combiner 226 are irrelevant During the 
error correction symbols segment, no data is entered into the encoders by router 222, multiplexer 221 is set to pass the 
output signal of combiner 228 to channel 10. and combiner 226 cydes twice through the five RS encoders and delivers 

40 their error encoding symbols jo channel 1 0. Data that arrives at that tsme is stored in buffer 220. 

The principle is tne same for data that is assumed to have bean interleaved in accordance with the illustration in 
FIG. 8, but the specie sequencing is different. The table below tliuslrates the actions in connection with the first 1 7 sym- 
bols for the arrangement corresponding to FIG. 8. 

45 
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syrn 
bol 


router 221 


Gomfainer 226 


i 


encoder 1 & ;ipp<;y data so encoder i 




2 


apply c-ata to encoder 3 




3 


apply data to encoder 5 


... 
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output error correcting symbol from encoder 2 


5 


apply data to encoders 
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apply daia to encoder 1 
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apply data to encoder 3 
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apply data to encoder 5 
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output error correcting syrnbo! from encoder 2 


10 


apply data to encoder 4 
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U: 


appty data to encoder 1 
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appsy data to encoder 5 




14 


reset encoder 2 a apply data to encoder 




15 


apply date !o encoder 4 
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apply data to encoder 1 
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output error correcting symbol from encoder 3 



tt may be rioted tiiat the cell where encoder 2 is reset is determined, for example, by designer's choice, by advanc- 
ing 1 3 ceils (the length ot the codeword with the 2 error correcting symbols) 'ram the point whsre encoder l is reset. 
The same apples tor the resetting of all other encoders. 

.as The actual control is exercised by controller block 250. The specific circuitry within block 250 (counters, shift regis- 
?ets and some combinatorial logic) is not presented here because it is perfectly conventional and because it will depend 
cm the particular interleaving schema that is iropsied, or presumed. The important thing to note, however, is that the FIG. 
10 arrangement is general enough to handle block interleaving, convolutions! interleaving (as disclosed above) and 
product encoding that could combine, for example, block interleaved and convolutions!! y interleaved data (as disclosed 

-■so below). 

The following presents an arrangement ot a implied corcvolutiona! interleaving of codewords of 120-symbcl length 
and an interleaving depth of 30. 

C iMt9> C mvs? vi l ... C m .297, C, n? $$, 

Cm, I MS. Cnvl.1 14* &m-Z, 1 W- — &n^2&,6- C m-29,2> 
* 5 ' ,517. Citi-1,1 ?3- 1Q9- ■•■ C m-28.5> Pm-aB.L 

Cm. 116- Cm-) Cm-2,106' ••■ C m P.BA' C fiv?9,0. 

Cm.nS- C m-i.iii> Cm-2, 107' -•• Cm..g8> C m< .t.119< 

C .m.1 C m 1,1 iO- ■ Qm-2, 106 Cfrt-aa,2> CroH.HB. 

Cm.1.13. Cfn.t.199. 105. ■■■ Gm-iSS.I' C raf .(,11T. 

S0 C m>) )2 . G m . , >ies8 , .Ctn.2. 1 04. - C m-28,<J- C om-1 ,1 1 6' - ■ 

The signals of the first column are routed by element 222 so a first encoder (223). the signals of the second columns 
are routed to a second encoder {224), and so on. Elements C^g 3 through C m . z9 ,o are the redundancy symbols. 
Viewed another way, each set of D consecutive symbols is distributed among D encoders, and every (D-hl)" 1 symbol is 
applied to the same encoder. 

FIG. 1 1 presents a somewhat different encoder architecture, where the memory of buffer 220 is embedded in the 
encoders and the data as well as the redundanS symbols are provided by the encoders It is shown tor the convolutions! 
anangarrient present-ad above wih 120 -symbol codewords and an interleaving depth of 30. PEG. 12 presents still 
another architecture, where a separate buffer is used for the data path and the encoding path, allowing more complex 
encoding structure. 
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At the receiver end, (he arriving data can be- utilized immediately, if desired, because it arrives in the same order 
that It had been generated by whatever equipment crealed the data that had been applied to buffer 220 in the transmit- 
ter, ff trie error correction codes are to be utilised, then the data must first be evaluated whether a transmission error 
occurred. Conceptually, She decoding can be dorse essentially in the very same manner as the error correcting symbols 

■5 were generated in the transmitter of FIGS. 10-12. That is, the data can be routed to a collection of RS decoders, error 
correcting symbols cart be generated and then used to evaluate the need to correct symbols that arrive from the trans- 
mitter. Thereafter, additional processing must be carried out to correct errors, if any. and finally, the corrected data can 
be deliver ed to its uiiimste user. That means, of course, that the arriving data must be delayed (and maintained) prior 
to its delivery to the ultimate user until the error correction processing is accomplished; ergo, a memory is needed. More 

io specifically, the amount of memory needed is equal to that which is sufficient to store the entire codeword, and to store 
newly arriving information while the codeword is evaluated and corrected. 

in the arrangement of FIG, 7, tor example, the implied interleaving is black interleaving and the evaluation and cor- 
rection cannot stan until ail data ts in (at the. end of the 1 1th row in FIG. 7). The evaluation of eis S codewords starts in 
the "i 2th row, and all S codewords must, then, be evaluated cortcurrently. If the equipment thai can evaluate and correct 

;s the 5 codewords takes, for example, 6 symbols periods per codeword, or 30 symbol periods, then the total memory 
required is 65 symbols to store the 5 codewords artd 30 symbols to store She incoming data during the correction phase: 
for s total of 95 symbols, or 0{N+L), where L is the number of symbols necessary to correct a codeword. (As an aside, 
the element that carries out the calculations necessary to correct transmission errors is not limited to operating at the 
symbol rate of tae incoming data and, typically, such an element, e.g. a microprocessor, can operate at speeds that are 

so far higher than the symbol rate of the data.) 

In the arrangement of FIG. 8. on the other hand, the codewords do not begin and end si the same time and, there- 
fore, the codeword evaluations and corrections also do not need to occur concurrently. Specifically, in She FIG. 8 
arrangement there are 13 cells from the end of one codeword So the end of the next codeword, and 5 ceils from the time 
the last redundant symbol of s particular codeword arrives <s.g.. the codeword in column 1 of the FIG. 8 matrix) and the 

25 first symbo! of the next irscarnation of that codeword arrives. Since >t takes only 8 symbol periods to correct a codeword 
(with equipmem issed in the above example), it follows that one syrnboS of additional memory is required. Hence, the 
totaS memory required in the receiver for the FIG. 8 arrangement is S6 symbols. Ore the other hand, with a taster proc- 
essor that requires only 5 symbol periods to correct a codeword, only 65 symbols of memory would be required - which 
is the minimum memory necessary. One can think of the memory requirement as N'D, plus L-D, with the minimum being 

30 hsO. 

FIG. 1 3 presents a block diagram of still another embodiment that is adapted to the principles of this invention. Just 
as with the arrangement of FIG. 1 1 , it can serve as an encoder (within a transmitter), or as a decoder (within a receiver) . 
It includes a memory 310, a processor 320 coupled to memory 310 and a controller 330 coupled to memory 310 and 
processor 320. As depicted, memory 310 includes a number of data ports (input, output to user and output to processor 
3£ 320) but in actuality, a single I/O port is time shared. When acting as a receiver, processor 320 reads data from memory 
310 and analyzes that data. if correction of da la symbols is called for. processor 320 writes data into memory 310. 

Processor 320 carries out the processing necessary for detecting errors and for correcting errors. Some memory 
is needed to store temporary results of the error detection processes, and that memory may be included within control- 
ler 330 or be part o* memory 310. A program store memory will, ol course, provide trie necessary storage area. That 
40 memory aiso holds the programs that control processor 320. 

The error correctors processing method that processor 320 carries out is not described here because it may be per- 
fectly conventional and forms no part ot this invention. Whatever coding schema is selected (be it Reed -Solomon, or 
other coding), the corresponding decoding must be applied by processor 320. What is unique in both the transmitter 
and She receiver arrangements is the utter flexibility to handle whatever Implied interleaving is selected, and the simplic- 
45 ity of the attendant corrirofs. Thus, for example, for the interleaving arrangement shown in FIG. 8 and the FIG. 13 
arrangement used as & receiver, when the controller focus is on eel! t (first row, first cdumn) the following activities take 
piace: 

A1. memory 310 outputs the symbol stored for codeword 1 in call 1 (which had already been corrected, if nec es- 
se sary) and delivers it to the user; 

A2 the error detection temporary store for codeword 1 {in controller 330) is reset: 

A3, the syrnbO! arriving at the receiver is declared to be the first symbol of the next codeword i and is stored in ceil 

A4. the error detection information in the temporary store for codeword 1 is updated with the information stored in 
ss cell 1 : and 

AS. the error correction processing for codeword 2 is initiated. 

When the controller focus fe on cell 2, the following activities take pace: 
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31 . memory 310 outputs the symbol stored for codeword 3 in eel! 2 artel delivers i! to the user; 
82. ine symbol arriving at the receiver is declared to be the next symbol of codeword 3 and it is stored in ce!i 2: 
B3. -he error detection information in the temporary store for codeword 3 is updated with the information s sored in 
ceii 2: and 

s B4 . the error correction processing for codeword 2 is continued. 

By the time focus rests on cell 1 3, the error correction processing of codeword 2 is completed, allowing ceil 1 4 to Ouijxi! 
the correct first symboi of codeword S; whereupon process steps A1 through AS, above, can be executed. 

To demonstrate trie flexibility of the arrangement disclosed herein, an extension io product encoding is preserfled. 

so By "product" what is meant is that the implied interleaving can be viewed to be two dimensional, as illustrated, for exam- 
ple, in FiG, 14 which includes an implied convolutional interleaving arrangement in accord with RG. 8 (column-wise), 
with an implied block interfering row-wise. Since those error correcting syrnbds follow me o'ata as it arrived (where 
cetts ara filled a row st a time), the modification to me transmitter is merely one additional encoder in parallel with the 
encoder bank frustrated, for example, in FIG. 10. Specifically, as shown in FIG. 15. the transmitter includes an adcS- 

is tionai encoder 125 whose output is delivered to channel 10 under control of muftipiexer 221. The FIG. 15 extension to 
the FIG. 1Q arrangement is mereiy illustrative, of course. The other architectures, such as mat of FIG. 13. are similarly 
extendible. 

At the receiver, when focus is on the row error correcting symbol. She information is available to perform whatever 
procedure is necessary within processor 320. The erroneous symbol(s) in the row can then be corrected, or information 
about those symbofs can be stored and taken into account when the codeword error correction process is executed. 
For example, with a single parity in each row, a single error in the row can be identified That information can b© com- 
municated to each o5 the codeword correction procedures, and that information can simplify those procedures. For 
exampie. knowledge that an error exists in row 4 of FIG, 8 corresponds to knowledge that an error may exist in symbol 
4 of codeword 1 , in symbol 12 of codeword 3 (the first redundant symbol in codeword 3). in symbol 7 of codeword 5. in 

as symbol 2 of codeword 2. or in symbol 1 0 of codeword 4. 

The above discussion regarding corrvolutional interleaving depicted the conventional condition of regular conwoli]- 
tionai interleaving where every (O-t-1)* symbol belongs to a particular codeword. That is not a requirement, however. 
Indeed, -the encoder/decoder of. for example, FIG. 13 can handle a random arrangement that does not foliow the above 
notion. FIG. 1 6 illustrates 5*ich an implied conventional interleaving where every (D+1 f* symbols does mt necessarily 

so belong to a particular codeword. In contradistinction to regular convoliitional interleaving, this may be considered 
random ccjnvoiutjonai interleaving. Even a higher level of "randomness" is acceptable in, for example, abandoning the 
notion of consecutive symbols are routed to different encoders. That, in fact, is not a requirement, and one can easily 
devise arrangements where ali, or some, of the encoders have a pair of consecutive synthesis routed to them. The max- 
imum number of consecutive symbols is, of course, me number of symbols in a codeword, and that, obviously, is me 

3* limit (yielding a non -interleaved arrangement). 

Claims 

1. An encoder including a memory (310), and processing means (320) coupled to the memory including means (330) 
m tor writing incoming symbols into the memory, means (330} lor reading symbols out oJ me memory at rale higher 
than the rate of writing into me memory and applying the read symbols toa channel, means (330) for implementing 
0 encoders (D being an integer) in cooperation with the processing means and the memory by employing the read 
symbols in calculations aimed at developing redundant symJ>ols, where each set of O consecutive symbols are dis- 
tributed to different ones of the implemented D erscoders, and means (330) for applying the redundant symbols to 
ts the channel, 

cterscterreed in thet 

the calculations for she D encoders are reset in accordance with a selected implied convolutionai interleaving 
schema. 

iro 2. An encoder accofding fo claim 1 where, uncier control o? the processing means, in addition to each set of D con- 
secutive symbols being distributed to differ en! ones of the implemented D encoders, each (D+i) 81 symbol is 
empsoyed in the calculations of a particular encoder. 

3. An encoder according to claim 1 where, under control of the processing means, in addition to each set of O con- 
es secutive symbols distribute to differs;* ones of the implemented D encoders, at least one set that contains 

each £Q+1 } th symijo! is employed in the calculations of more man one encoder. 

4. An encoder according to claim 1 where incoming symbols are written into a data buffering region of the memory, 
symbols are read out of the data buffering region, and imple mentation of the D encoders involves storage of calcu- 
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iasion results, which results am stored in another region of the memory. 

S. The encoder o?" claim 1 where the reading out of symbols out of the memory is in the same order as symbols written 
into the memory. 

s 

S. The encoder of ciaim 1 further comprising means for block encoding said incoming signals. 

7. The encoder of claim 6 wherein said block interleaving and said convolutions! interring form a product encoding 
arrangement 

?c 

8. Art implied interleaving encoder responsive to & stream ot incoming data symbols that is assumed to comprise 
codewords having N symbo's which include redundant symbols and which are interleaved in a convolutions! inter- 
leaving pattern id an interleaving depth O, for developing the redundant symbols for each of the codewords and 
inserting them in She stream ct incoming data symbols in accordance whh the interleaving pattern, including a p!u- 

is raiity of D encoders (223), each of which develops a set of at least one redundant symbol corresponding to a 
sequence of symbols shat define a data portion of & codeword, a first router (222), responsive to incoming data for 
delivering successive symbols eo different ones of the D encoders in cyclic manner, and a combiner (226, 221). 
responsive Jo the redundant symbois developed by the D encoders and to output data of the first memory, for apply- 
ing information arriving at the combiner to a channel, characterized srs thai 

so each of tne D encoders is arranged handle codewords that are offset from the codewords handled by the 

other encoders by at ieaet two symbols. 

9. A method for encoding and interleaving an applied sequence of input signals arriving at regular intervals, the 
sequence having a given order, to develop an interleaved output signal comprising the input signals in a sequence 

■2$ having the same given order, the method comprising the steps of : 

routing the input signals to a plurality of encoders; 

in response to the input signals routed to ihe encoders, the encoders developing a selected number of redun- 
dant signals and outputSng the redundant signals, where the inserting of redundant signals by any one of the 
30 encoders is staggered in time relative to any other one of ihe encoders by more than one of said intervals; and 

routing the output signals of the encoders to an output port. 

10. A decoder responsive to an incoming stream of data that includes codeword that are N symbols long which are 
interleaved to a depth D. where each codeword includes information symbols and redundant symbols, comprising: 

a processor {320} for correcting errors found in said codewords; 

a storage device {310), coupled to said incoming stream of data and to said processor, having memory allo- 
cated for storing D{L+N5 symbols, where L is the number of symbols arriving at the decoder during the time 
needed by the processor to correct errors found in one codeword; and 
to a controller (330) for controlling said processor as well as input and output of data to and from the memory- 

where 

errors to be corrected are corrected by the processor by overwriting corrupted symbols with corrected 
symbols, arid 

symtoois; of the incoming data are stored in Ihe memory and the information symbols are delivered to a 
o$ user port, from ihe memory, corrected as necessary, in the same order that the data arrived. 

1 1 . The decoder of cairn "SO where the interleaving of the incoming stream of data is convoiutionaf interleaving. 

12. The decoder oi claim 11 and the memory contains at most ND symbols ol memory devoted to storing incoming 
so data. 
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accordance with such treatment, redurtdarst symbols 
are generated and inserted into the transmitted data 
stream. A! the receive?, the incoming data is delayed, 
corrected, and {hs ir-formatlon symbols in the incoming 
data are delivered %o the user, corrected as necessary. 
Irs the same order as the information symbols arrived at 
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